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Abstract: An overview and synthesis of results and criteria for open- loop control- 
lability of Hamiltonian quantum systems obtained using dynamical Lie group and 
algebra techniques is presented. Negative results for open-loop controllability of 
dissipative systems are discussed, and the superiority of closed-loop (feedback) 
control for quantum systems is established. 



1. INTRODUCTION 

Controlling the dynamics of quantum systems 
has been a long-standing goal of quantum physi- 
cists and chemists, which has received renewed 
attention recently driven by the desire to build 
quantum information processing devices. A cen- 
tral problem one faces when attempting to control 
quantum systems, is the question to which extent 
it is possible to control the dynamics of the sys- 
tem such as to achieve a certain aim or control 
objective. 

In the following we first provide a synthesis of re- 
cent results on controllability of finite-dimensional 
closed quantum systems subject to open-loop co- 
herent control, i.e., coherent control without mea- 
surements and feedback. The results show that for 
these systems open-loop control is sufficient for 
controllability in most cases. For open systems, 
i.e., systems subject to dissipative effects due 
to uncontrollable interactions with their environ- 
ment, however, it has been shown that open-loop 
control is generally not sufficient for controllabil- 
ity, even in finite dimension. We discuss the neg- 
ative controllability results in this case. Finally, 



we present a brief overview of recent results using 
closed- loop control of quantum systems, i.e., con- 
trol involving measurements and feedback, which 
indicate its superiority over open-loop control in 
various settings. 

2. MATHEMATICAL MODEL 

We consider the problem of control of quantum 
systems whose state space is a Hilbert space TC of 
dimension N. The state of such a system can be 
described by a density operator p. 

Definition 1. A density operator is a positive op- 
erator on Ti with unit trace. If it has rank one 
it is said to represent a pure state, otherwise it 
represents a mixed state. 

A density operator representing a pure state is 
simply a projector onto a one-dimensional sub- 
space of the Hilbert space Tt, i.e., using Dirac 
notation we can write p = |4 r )(^ r |, where \^f) is 
an element in Ti called a wavefunction. Thus, the 
special case of a pure state can also represented 
by a wavefunction € Ti.. 



In general the operator p satisfies the quantum 
Liouville equation 



ihf t p(t) = 



H[f(t)],p(t)} +ihjC D [p(t)l (i) 



where the commutator determines the Hamilto- 
nian part of the evolution, and the second term 
represents the non-Hamiltonian part due to dissi- 
pative effects, which may include certain measur- 
ments that weakly perturb the system. The oper- 
ator H [f (t)] is the total Hamiltonian of the system 
subject to the control fields f(t). For the purpose 
of controllability studies the control Hamiltonian 
is usually assumed to be control-linear, i.e., 



M 



H[f(t)]= H Q +J2 fm(t)H„ 



(2) 



where Hq is the internal system Hamiltonian and 
H m , m > 0, arc the interaction terms. This 
assumption is generally reasonable as long as the 
control fields are sufficiently weak compared, e.g., 
to relevant intra-atomic or molecular forces. 

In the absence of dissipative effects, i.e., when 
Cd = 0, the evolution of the system is Hamil- 
tonian and the density operator satisfies the dy- 
namical evolution equation 

p{t) = U(t,t )p U{t,t )\ (3) 

where U(t, to) is the Hilbert space evolution oper- 
ator that satisfies the Schrodingcr equation 



H[f(t)]U(t,t ), 



(4) 



and is hence restricted to the unitary group U (N) , 
N being the dimension of the Hilbert space H. 

The constraint of unitary evolution for Hamilto- 
nian systems imposes restrictions on the quantum 
states that can be reached from a given initial 
state. Since the former limitations are indepen- 
dent of the control fields and their type of inter- 
action with the system, we shall refer to them as 
kinematical constraints, to distinguish them from 
dynamical constraints arising from constraints on 
the control fields or the interaction with those 
fields. Precisely, given an initial state po and a 
target state pi, the target state is kinematically 
admissible if and only if there exists a unitary op- 
erator U such that p\ = Up W . This equation de- 
fines an equivalence relation that partitions the set 
of density operators into kinematical equivalence 
classes. Two density matrices p\, pi are kinemat- 
ically equivalent if they are unitarily equivalent, 
i.e., if f>2 = Up\W for some unitary operator U. 
It follows immediately that two density matrices 
are kinematically equivalent if and only if they 
have the same eigenvalues. Hence, the set of pure 
states forms one such equivalence class of states. 



3. DEGREES OF CONTROLLABILITY FOR 
CLOSED SYSTEMS 

Closed quantum systems, i.e., systems that are 
decoupled from their environment except for (con- 
trolled) interactions with coherent control fields, 
exhibit Hamiltonian dynamics if they are sub- 
jected to open-loop coherent control. Various no- 
tions of controllability exist for such systems. De- 
pending on the application, one may be interested 
in complete controllability, observable or operator 
controllability, and mixed-state or pure-state con- 
trollability [Albertini and D'Alessandro (2001); 
Schirmer et al. (2002a)]. 

Definition 2. A quantum system subject to Hamil- 
tonian dynamics is completely controllable if any 
unitary evolution is dynamically realizable, i.e., 
if for any unitary operator U, there exists an 
admissible control-trajectory pair (i(t),U(t,to)) 
defined for to < t < tp (for some tp < oo) such 
that U = U(t F ,t ). 

Definition 3. A quantum system subject to Hamil- 
tonian dynamics is density matrix controllable if 
given any pair of kinematically equivalent density 
matrices po and p\, there exists an admissible 
control-trajectory pair (f(t), U(t, to)) defined for 
to < t < tp (for some tp < oo) such that 

pi = U(tp,to)poU(tF,to) f ■ 

Definition 4- A quantum system subject to Hamil- 
tonian dynamics is pure-state controllable if for 
any two pure states given by the (normalized) 
wavefunctions \^o), |^i)> there exists an admissi- 
ble control-trajectory pair (i (t) , U (t , t )) defined 
for to < t < tp (for some tp < oo) such that 
|*i> = t )|*o>. 

Definition 5. A quantum system subject to Hamil- 
tonian dynamics is observable controllable if for 
any observable A and initial state po of the sys- 
tem, there exists an admissible control-trajectory 
pair (f(t),U(t,t )) defined for t < t < t F (for 
some tp < oo) such that the ensemble average 
Ti[p(t)A] of A assumes any kinematically admis- 
sible value [Girardeau et al. (1998)]. 



4. LIE- ALGEBRAIC CRITERIA FOR 
CONTROLLABILITY 

The notions of controllability for closed quantum 
systems subject to open-loop coherent control 
defined in the previous section can be related to 
the dynamical Lie group and Lie algebra of the 
control system. 

Definition 6. The dynamical Lie algebra of a 
quantum system with Hamiltonian (2) is the Lie 



algebra C generated by the skew-Hermitian oper- 
ators iH m by taking all linear combinations and 
iterated commutators. 

The associated dynamical Lie group G is formed 
by the elements exp(x) where x is an element of 
C. Knowledge of the dynamical Lie group of the 
system is fundamental to understanding the dy- 
namics of the system and especially limitations on 
its control since the dynamical evolution operator 
U(t, to) of the system is constrained to this Lie 
group for all times, independent of the control 
fields applied, and the set of reachable states and 
dynamically realizable bounds on the expectation 
values of observables depend on this dynamical 
Lie group. 

For Hamiltonian quantum systems it is obvious 
from the definition that only a system with dy- 
namical Lie group U(N), where N is the di- 
mension of the Hilbert space H, can be com- 
pletely controllable. Density matrix controllability 
requires that the dynamical Lie group act transi- 
tively on all equivalence classes of density matri- 
ces, while pure-state controllability requires only 
transitive action of the dynamical Lie group on the 
equivalence class of pure states. Since the latter 
can be represented by normalized wavefunctions 
or unit vectors in C w , pure-state controllability 
requires only transitive action of the dynamical 
Lie group on the unit sphere in <D N . 

It can furthermore be shown that density ma- 
trix controllability is both necessary and sufficient 
for observable controllability as defined above 
[Schirmer et al. (2002a)]. Based on these obser- 
vations, the degree of controllability of a Hamil- 
tonian quantum system with control-linear Hamil- 
tonian (2) can be characterized in terms of its 
dynamical Lie algebra: 

Theorem 7. [Albcrtini and D'Alessandro (2001); 
Schirmer et al. (2002a)] A Hamiltonian quantum 
system with control-linear Hamiltonian is 

• completely controllable if and only if C ~ 
u{N). 

• density matrix controllable if and only if 
£~su(N) or £~u(N). 

• pure-state controllable if and only if C is 
isomorphic to either u(N), su(N), or (when 
N = 21) sp{£), sp(£)(Bu(l). 

Complete controllability thus implies density ma- 
trix and observable controllability and the latter 
guarantees pure-state controllability. According to 
our definition complete controllability is strictly 
speaking a slightly stronger requirement than den- 
sity matrix or observable controllability but the 
difference is essentially only a phase factor, which 
is not important for most applications. 



Definition 8. For simplicity we shall therefore call 
a system controllable if it is density matrix and 
observable controllable. 

An interesting consequence of the previous result 
is that pure-state controllability is equivalent to 
mixed-state controllability if the dimension of H 
is odd, but it is a weaker requirement if the 
dimension of TL is even, i.e., there exist even- 
dimensional quantum systems that are pure-state 
controllable but not mixed-state controllable. 

For a system that is not controllable there exist 
initial states for which the set of dynamically ac- 
cessible target states does not comprise the entire 
kinematical equivalence class, i.e., at least some 
of the kinematical equivalence classes are parti- 
tioned into disjoint subsets of dynamically equiv- 
alent states. If the system fails to be pure-state 
controllable then there exists such a partition for 
the equivalence class of pure states [Schirmer and 
Solomon (2001); Schirmer et al. (2002c)]. How- 
ever, lack of controllability does not necessarily 
imply that the dynamical Lie group of the sys- 
tem does not act transitively on any kinematical 
equivalence class. For instance, every dynamical 
Lie group clearly acts transitively on the equiva- 
lence class of completely random ensembles, which 
consists of the single element pn = j^In, where 
In is the identity matrix of dimension N. 

5. GRAPH-CONNECTIVITY CRITERIA FOR 
CONTROLLABILITY 

Although a characterization of the degree of con- 
trollability in terms of the dynamical Lie algebra is 
useful, it can be quite time-consuming to compute 
the Lie algebra of a system for large N. It is there- 
fore desirable to have criteria for controllability 
that are easier to verify. 

For strongly regular Hamiltonian control systems 
with a control Hamiltonian of the form 

H[f{t)]=H Q + f(t)H 1 , (5) 

it has been shown that controllability can be 
related to the transition graph determined by the 
interaction Hamiltonian Hi. 

Definition 9. The internal system Hamiltonian 
Hq is regular if it has unique eigenvalues, i.e., if 
each eigenvalue occurs with multiplicity one. Hq 
is strongly regular if in addition, the difference 
between any pair of eigenvalues is unique, i.e., 
Ei - Ej ^ E m - E n unless (i,j) = (m,n). 

Definition 10. The transition graph of a quantum 
system subject to a single control field is obtained 
as follows: Choose a Hilbert space basis {\n) : 1 < 



n < N} with respect to which Ho is diagonal and 
identify each state \n) with a vertex, and each non- 
zero element of the matrix representation of the 
transition Hamiltonian Hi (with respect to this 
basis) with an edge. 

Note that the transition graph is unique only for 
systems with regular Hamiltonian. For systems 
with degenerate energy levels there are various 
choices of Hilbcrt space bases that diagonalizc 
Hq, which need not correspond to equivalent 
transition graphs. This best illustrated by an 
example. 

Example 11. Consider a three- level A-system, i.e., 
suppose we have E\ = £3, E 2 > E\ and 
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with respect to the canonical basis |1), |2) and 
|3). The transition graph associated with H\ is 
connected if d 7^ 0. 

However, if we choose another basis \ip±) = (|1) ± 
\Z))/y/2 and \ip 2 ) = |2) the n we obtain 
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with respect to the basis \ip+), \4>-) and \tp 2 ). 
Note that Ho is diagonal but the transition graph 
associated with Hi is not connected. Instead, we 
obtain a coupled two-state system |^>+), |2) and a 
decoupled (dark) state . 
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Theorem 12. [Altafjni (2002a)] If the internal sys- 
tem Hamiltonian H is strongly regular and the 
transition graph determined by Hi is connected 
then the system is controllable. 

A similar result was first obtained for pure- 
state (or wavefunction) controllability [Turinici 
and Rabitz (2001)]. However, the theorem above 
is stronger in the sense that it guarantees den- 
sity matrix and observable controllability, not just 
pure-state controllability. 



6. OTHER CONTROLLABILITY RESULTS 

Theorem 12 is very useful when applicable as it 
is much easier to verify than the general Lie alge- 
braic criteria for various notions of controllability. 
Note, however, that the hypothesis of strong reg- 
ularity of H is restrictive. Although this require- 
ment can be relaxed slightly, e.g., transitions that 
occur with zero probability can be ignored, etc., it 
essentially restricts the applicability of the result 
to systems with non-degenerate energy levels and 
non-degenerate transition frequencies. 

Nevertheless, there are positive controllability re- 
sults for systems that do not satisfy the hypothesis 
of strong regularity, or even regularity of Hq. For 
instance, in some cases the general Lie algebraic 
criteria (theorem 7) can be applied to derive con- 
ditions on the parameters of a model system that 
guarantee controllability. 

Theorem 13. [Fu et al. (2001); Schirmer et al. 
(2001)] A quantum control system with Hamil- 
tonian H = H + f(t)Hi, where 



H 



N 

E 

n=l 
N-l 



E n \n)(n\, 



Hi=Y^ d n (\n)(n+l\ + \n+l)(n\ 



71=1 



is controllable if d n 7^ for 1 < n < N 
either 



1 and 



(1) there exists p such that ui n 7^ uo p for n ^ p 
where ui n = E n+1 - E n ; or 

(2) u n = uj for all n but there exists p such that 
v n ^ v p for n 7^ p, where v n = 2d 2 n — d 2 n _ x - 
4+1- 

If N = 2p then d 2 p _ k 7^ d 2 +k for some k 7^ is 

required as well. If in addition Tr(/f ) 7^ then 
the system is completely controllable. 

Essentially, this theorem shows that a sequentially 
coupled Hamiltonian quantum system is control- 
lable if there is a single unique transition fre- 
quency, and this is not the 'middle' transition in 
case of an even-dimensional system. If the unique 
transition frequency is the middle transition and 
the system dimension is even, then the degree 
of controllability depends on whether the system 
satisfies a symplectic symmetry relation, in which 
case we have only pure-state controllability, or 
not, in which case we have general controllability 
[Schirmer et al. (2002b)]. 

If there is no unique transition frequency then 
controllability depends on the values of the dipolc 
moments, but even if all transition frequencies are 
the same, the system is still controllable for most 
choices of the dipole moments. 



Furthermore, even for systems with no non- 
degenerate energy levels (i.e., completely non- 
regular H ) such as electronic transitions in 
atomic or ionic systems, positive controllability 
results have been obtained in many cases using 
Lie algebraic techniques [Schirmcr ct al. (2002a)]. 

The question arises whether the hypothesis of 
strong regularity in theorem 12 is necessary. Un- 
fortunately, in spite of some encouraging results, 
the answer is yes. Regularity is not sufficient for 
controllability in general. For instance, the Lie 
algebra of a system with equally spaced but non- 
degenerate energy levels and uniform transition 
dipolc moments has been shown to be sp(N/2) 
if N even, and so(N) if N odd [Schirmer et al. 
(2002b)]. Thus, the system is remains pure-state 
controllable if it is even-dimensional, but is not 
controllable in the odd-dimensional case. Note 
that this result does not violate theorem 13 since 
there is no unique transition frequency and the 
system does not satisfy hypothesis (b) of the the- 
orem either. 

7. CONTROLLABILITY OF OPEN SYSTEMS 

While there are perhaps still some interesting 
open problems regarding the degree of controlla- 
bility of closed quantum systems subject to Hamil- 
tonian dynamics and open-loop coherent control, 
the results of the previous sections show that 
their controllability properties are quite well un- 
derstood, and that they are controllable in most 
cases. The situation is quite different for open 
quantum systems, i.e., systems that interact (in- 
coherently) with their environment in addition to 
any interaction with coherent control fields. Such 
incoherent interactions with the environment lead 
to a non-zero dissipative term Co in the quantum 
Liouville equation, and inevitably result in non- 
Hamiltonian dynamics. 

It has been suggested that dissipative effects in- 
crease the amount of control since the dissipative 
term, being non-Hamiltonian, removes restric- 
tions such as unitary evolution and tends to en- 
large the dynamical Lie group of the system. How- 
ever, this picture is only partially true. Indeed, 
dissipative effects usually enlarge the Lie algebra 
of the system [Solomon and Schirmer (2002)], and 
states not reachable from a given initial state via 
coherent control in the non-dissipative case may 
become reachable when dissipation is added. In 
fact, important applications such as optical pump- 
ing or laser cooling rely on the combined effect of 
dissipation and coherent control fields [Schirmer 
(2001); Schirmer and Solomon (2002)]. 

However, dissipative effects generally do not in- 
crease open-loop controllability of quantum sys- 
tems. Before we discuss why, it should be noted 



that it does not make sense to distinguish between 
pure and mixed state controllability for open sys- 
tems, since dissipative effects can convert pure 
states into mixed states and vice versa. Further- 
more, since the kincmatical equivalence classes 
of states that exist for closed systems (subject 
to Hamiltonian dynamics) are not preserved, the 
only sensible definition of (state) controllability 
for open systems appears to be the following. 

Definition 14- An open (non-Hamiltonian) quan- 
tum system is (density matrix) controllable if any 
target state represented by a density operator pi 
can be reached from any given initial state p . 

It can be shown that open quantum systems are 
virtually never open-loop controllable according 
to this definition [Solomon and Schirmer (2002); 
Altafini (2002b)]. The main reason for this is that 
dissipative effects are (a) generally not control- 
lable - but rather constitute a non-Hamiltonian 
drift (or disturbance) term - and always lead 
to irreversible semi-group dynamics. This means 
that for open systems there always exist states 
that are not accessible (via open-loop control), 
and the set of such states may be large. 

Nonetheless, non-Hamiltonian drift terms may 
render states not accessible from a given initial 
state by coherent control in the non-dissipative 
case, accessible via open-loop control. Thus, it 
appears that the more important issue for control 
of open systems is the study of the set of reachable 
states. For systems with sufficiently small non- 
Hamiltonian drift terms, it may be interesting 
to compare the set of reachable states with and 
without drift as a function of time and to consider 
the amount of overlap of these sets. Since dissi- 
pative systems tend to asymptotically converge 
to a stationary state (which may depend on the 
initial state) when no control fields are applied, 
and coherent control operations are unitary, it is 
to be expected that the set of reachable states 
from any initial state will contract with time for 
many systems. One question of interest in this 
regard is what states are asymptotically reachable 
for a given open system using open-loop control. 



8. CLOSED-LOOP (FEEDBACK) CONTROL 

The previous sections have focused exclusively on 
the extent to which it is possible to control a 
quantum system (Hamiltonian or otherwise) us- 
ing open-loop coherent control. While there are 
many potential applications of open-loop control 
for quantum systems, this type of control clearly 
has its limitations. An alternative is to add mea- 
surements and condition the controls based on the 
result of these measurements. This type of control 



is generally referred to as closed-loop or feedback 
control. 

Feedback control can be difficult to realize for 
quantum systems since feedback requires mea- 
surements, which perturb the system and gener- 
ally lead to nonlinear dynamics. Projective mea- 
surements give rise to discontinuous evolution and 
jumps in state space. Weak (non-projective) mea- 
surements can ameliorate the situation by elim- 
inating discontinuities, but may be difficult to 
perform and still lead to non-linear dynamics. 

Nevertheless, many different types of measure- 
ments and feedback are conceivable for quantum 
systems, and various schemes have recently been 
proposed. A detailed discussion of this topic is 
beyond the scope of a short paper such as this, 
but closed-loop control has been shown to be 
generally more powerful than open-loop control, 
especially for control of open system dynamics 
[Lloyd and Viola (2000)]. Feedback control using 
weak measurements has been proposed for tasks 
that are not possible via open-loop coherent con- 
trol such as continuous quantum error correction 
[Ahn et al. (2003)]. Furthermore, the combination 
of measurements and coherent control allows the 
implementation of non-unitary dynamics even for 
otherwise closed systems [Lloyd and Viola (2002)]. 
Recent results even suggest that non-dissipative 
systems that are not open-loop controllable be- 
cause the dynamical Lie group does not act transi- 
tively on the equivalence classes of states, may be 
controllable if certain measurements are possible 
[Mendes and Man'ko (2002)]. 

9. CONCLUSION 

We have presented a concise summary of recent re- 
sults on open-loop controllability of (closed) quan- 
tum systems subject to Hamiltonian dynamics, 
showing the importance of the dynamical Lie alge- 
bra and related Lie group in assessing the degree 
of controllability of the system. Negative (open- 
loop) controllability results of for open quantum 
systems with non-Hamiltonian drift terms have 
been discussed, and we have argued for the impor- 
tance of studying the reachable sets in this case. 
Finally, we have presented a brief discussion of 
recent results on closed-loop control of quantum 
systems, indicating the challenges of implement- 
ing feedback control, and demonstrating its supe- 
riority over open-loop control. 
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